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20 Mail Stop Appeal Brief - Patents 
Commissioner for Patents 
P O Box 1450 
Alexandria, VA 22313-1450 

25 

Sir: 



Appellants hereby reply to the Examiner 's Answer, mailed September 25, 
2006 (lefened to hereinafter as "the Examiner's Answer"), in an Appeal of the final 
3 0 I e j ection of claims 1 - 1 2 in the above-identified patent application. 



REAL PARTY IN INTEREST 
A statement identifying the real party in interest is contained in 
Appellants' Appeal Brief 

35 
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RELATED APPEALS AND INTERf ERENCES 
A statement identifying related appeals is contained in Appellants' Appeal 

Biief 

STATUS OF CLAIMS 
Appellants withdr aw the appeal of claims 5 and 9 . Claims 1, 7, and 12 aie 
being appealed. 

STATUS OF AMENDMENTS 
A statement identifying the status of the amendments is contained in 
Appellants' Appeal Biief . 

SUMMARY OF CLAIMED SUBJ ECT MATTER 
A Summary of the Invention is contained in Appellants' Appeal Brief 

STATEMENT OF GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL 

A statement identifying the grounds of rejection to be leviewed on appeal 
is contained in Appellants' Appeal Biief ' 

CLAIMS APPEALED 
A copy of the appealed claims is contained in an Appendix of Appellants' 

Appeal Biief 

ARGUMENT 

In the Response to Arguments section of the Examiner's Answer ^ the 
Examiner' asserts that Kupiec teaches an "explicit answei to a question" (col. 32, Table 8: 
Mailer, Noiman; col. 31, Table 7; col, 37, lines 38-53), 

Regarding the Examiner's comment on Table 8, Applicants note that the 

phrase "Mailer, Norman" actually refers to the title of the document, and that any explicit 

answer' to the question appears to be coincidental. In Table 8, Kupiec teaches "Document 
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Title: Mailer, Noiman " If "Mailei, Noiman" was the answer discoveied in the text, a 

person of ordinary skill in the ait would expect the answer to be "Noiman Mailei," which 

is how the cited name appears in the relevant text of Table 8. 

Also, legai'ding Table 8, Kupiec teaches that 

5 the piesentation here is diffeient fiom that of piioi ait IR 

systems. Answei' hypotheses aie shown to the user to focus his or hei 
attention on likely answeis and how they relate to other phrases in the 
question, The text presented is not necessarily from documents that have 
high similarity scores, but rather from documents that confirm phrase 

10 relations that lend evidence fbi' an answer.. This behavior' is readily 

understood by users, even though they have not been involved in the 
tedious intermediate work done by the system 

In Table 8, the fu'st two sentences are fiom primary 
documents . The last sentence confirming Norman Mailer as a novelist is a 

15 fiom a secondary document The sentence was confirmed by a lexico- 

syntactic pattern which identifies the answer hypothesis as being in a list- 
inclusion r elationship with the type phr ase,, 
(Col. 32, line 64, to col,. 33, line 11.) 

In the Appeal Brief; Appellants noted that, regarding Table 7, Kupiec 

20 teaches that ''the relevant articles are hewistically scored according to the degree and 

number of matches with the phiases of the input question After scoring, the relevant 

articles are ranked according to their scores '' (Col, 31, lines 34-41; emphasis added,) 

After the hypothetical answers are extracted, Kupiec teaches that "answer hypotheses are 

scored on a per-article basis according to the sum of the scores of the articles in which 

25 they occur'' (Col,. 31, lines 52-62; emphasis added.) Kupiec teaches that answer scores 

are based on the article scores; Kupiec does not disclose or suggest that answer' scores 

are based on scoring features of possible answers More importantly, Kupiec teaches 

that, 'for the question given in Table 7 MURAX produces the output shown in Table 5." 

(Col, 32, lines 38-39; emphasis added.) Thus, a person of ordinary skill in the art would 

30 read these steps as also applying to Table 8., 

Also, in the text cited by the Examiner, Kupiec teaches that 

it is illustrated in the following question and primary 
document match sentences: 

"What film pits Humphrey Bogart against gangsters in the 

35 Florida Keys?" 
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" , , , Bacall and Bogait became a famous romantic couple 
in films such as The Big Sleep (1946) and Key Laige (1948)." 

''Some of his most popular films were The Maltese Falcon 
5 (1941); Casablanca (1942), with Ingiid Bergman; The Big Sleep (1946) 

costaiiing his wife, Lamen Bacall; The Treasuie of Sieiia Madie (1 948); . 

Secondary co-occurience queiies determine that the answei 
hypothesis Key Largo co-occurs with Floiida Keys, but the other "film" 
10 hypotheses do not; thus in the absence of strongei evidence to the 

contraiy. Key Largo receives a preference . 
(Col 37, lines 38-53.) 

This teaching, however, does not contradict Kupiec's eailier teachings 

(cited above), including the teaching that answet scores are based on the article scores 

15 In the Examiner's Answer, the Examiner asseits that "each answei is 

scoied on a per article basis, which is the scoie of the answer hypothesis, which is not a 
document, each answei hypothesis being scoied based on an aiticle- (the article is scoied 
based on the degr ee and number of matches with the phiase of the input question which 
includes features of the answei), according to the sum of the scores of the articles in 

20 which they occur., More specifically, the article has a score, and the answer hypothesis 
also has a score, based on scoiing features of possible answers " 

As the Examinei acknowledges, Kupiec teaches that '^answer' hypotheses 
are scored on a per-article basis according to the sum of the scores of the articles in 
which they occur.''' Independent claim 1 requires extracting scoiing features fiom a 

25 candidate list of passages of possible answeis; scoiing the possible answers using the 
extracted features and a feature scoring function; and presenting the best scoiing 
possible answer to the user with context from the passage containing the answei,, 
Independent claim 7 requires a feature combination module, containing a 'feature 
extraction'' and ^'compute composite score*' components, an answer selection module 

30 and an answer presentation module, and independent claim 12 requires scoring ^^each 
possible answer phrase, selecting one or more of the best scoring answer phrases^ and 
displaying the answer phrases to the user.'' Kupiec determines scores based on an 
entire article, "where the degree and number of matches with the phrases of the input 
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questions'' (col. 31, lines 34-36); Kupiec does not disclose oi suggest that answeis aie 
scored using ^'extracted features and a feature scoring function,^^ 

Regaiding the Examiner's assertion that "one cannot show 
nonobviousness by attacking references individually where the rejections ate based on 
5 combinations of references/' Appellants note that the argument regarding Braden-Hardei 
was not presented to attack the refeiences individually, but was piesented to demonstrate 
that none oj the cited references disclose oi suggest certain limitations that distinguish 
the piesent claims ftom the cited prior ait,. 

Thus, Kupiec and Braden-Haidei et al, alone oi in combination, do not 
10 disclose or suggest extracting scoring features from a candidate list of passages of 
possible answers; scoring the possible answeis using the extracted features and a feature 
scoiing function; and presenting the best scoring possible answer to the user' with context 
from the passage containing the answer, as required by claim 1, do not disclose or 
suggest a feature combination module, containing a "feature extraction" and "compute 
15 composite scoie" components; an answer selection module and an answer presentation 
module, as lequhed by independent claim 7, and do not disclose or suggest scoring each 
possible answer phrase, selecting one or' more of the best scoiing answer' phrases, and 
displaying the answer phrases to the user, as requhed by independent claim 12 

20 Conclusion 

The rejections of the cited claims under sections 102 and 103 in view of 
Kupiec and Braden-Hardei et al., alone or in combination, are therefbie believed to be 
improper' and should be withdrawn. The remaining r'ejected dependent claims are 
believed allowable for at least the reasons identified above with respect to the 

25 independent claims 
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The attention of the Examine! and the Appeal Board to this matter is 



appreciated. 
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Date: November 17, 2006 
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Respectfully, 

Kevin M Mason 
Attorney foi Applicant(s) 
Reg. No. 36,597 
Ryan, Mason & Lewis, LLP 
1300 Post Road, Suite 205 
Fairfield, CT 06824 
(203) 255-6560 
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APPENDIX 

1 , A method for selecting answers to natmal language questions fiom a 
collection of 'textual documents compiising the steps of: 
5 exti acting scoring featuies fiom a candidate list of passages of possible 

answeis; 

scoring the possible answeis using the extracted featuies and a featme 
scoring function; and 

presenting the best scoring possible answei to the use: with context fiom 
1 0 the passage containing the answei ,. 

2., A method as in claim 1, wheiein the featuies used to score possible 
answeis consists of one oi moi'e of the following features; a semantic type of a cmimt 
suspected answei, a position of the suspected answer among all suspected answeis within 

15 all document passages, a position of the suspected answei among all suspected answeis 
within the given passage, a numbei of suspected answeis of a given semantic type 
retrieved within a given passage^ a numbei of words in a suspected answer that do not 
appear in the user question, a position of the semantic type in the list of potential 
semantic types for the question, an average distance in words between the beginning of 

20 the potential answer and the words in the question that also appear in the passage, a 
passage lelevance as computed by the information retrieval engine, a frequency of a 
given potential answer on the list, a semantic relation between words fiom the question 
and words from the potential answer, and a strength score that is a function of the 
relevance score., 

25 

3., A method as in claim 2, wheiein the featuie scoring function is a linear 
combination of weighted featur es , 
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4,. A method as in claim 3, wher ein the par'ameter s of the scoring function 
are manually determined,, 
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5,. A method as in claim 3, wherein the paiameters of the scoring function 
aie learned by a machine learning algorithm.. 

6., A method as in claim 1 where the candidate list of passages of possible 
5 answers is obtained fiom the collection of documents using an infoimation letiieval 
engine 

7. A computer system that extiacts answeis to natuial language questions 
from a laige collection of textual documents consisting of one oi mote of the following 
10 modules: 

a feature extiaction module; 

a feature combination module, containing a "featme extraction" and 
"compute composite scoie" components; 

an answer selection module; and 
15 an answer presentation module . 

8 A computer system, as in claim 7, wherein the feature ext action 
module extracts one or more of the following features: a semantic type of the current 
suspected answer, a position of the suspected answer among all suspected answeis within 

20 all document passages, a position of the suspected answer among all suspected answers 
within the given passage, a number of suspected answeis of a given semantic type 
retiieved within a given passage, a number of words in an suspected answei that do not 
appeal' in the user question, a position of the semantic type in the list of potential 
semantic types for the question, an average distance in words between the beginning of 

25 the potential answer and the words in the question that also appeal in the passage, a 
passage lelevance as computed the retrieval engine, a frequency of a given potential 
answer on the list, a semantic r elation between words fiom the question and words from 
the potential answei, and a strength score that is a function of the relevance score. 
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9 A coniputei' system as in claim 7, wheiein the featuie combination 
module employs a featuie scoiing function with paiameters learned by a machine 
learning method 

5 10. A computer system as in claim 7, wherein the answer selection module 

selects the answei with the best scoie obtained fiom the featuie combination module. 

11, A computer system as in claim 7, wherein the answei presentation 
module shows the top scored answei within the context as specified by a user or a 

10 system 

12, A computer' program pioduct that peifbims the steps of: 
deteitnining a featuie scoiing function duiing a training phase either 

manually or via a machine learning algoiithm applied to a set of training questions, 
15 corresponding answer passages^ and certain extracted featuies; and 

duiing an execution phase, extracting certain featuies from questions and 
conesponding possible answei phrases, applying the featuie scoiing function determined 
duiing the training phase to score each possible answers phiase, selecting one oi more of 
the best scoiing answei phiases, and displaying the answei phiases to the user with 
20 optional additional context fiom the answei passages . 
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EVIDENCE APPENDIX 
There is no evidence submitted pursuant to § 1 .130, 1 ,1.31, or 1 .132 or 
entered by the Examinei and relied upon by appellant , 
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RELATED PROCEEDINGS APPENDIX 
Theie aie no known decisions rendered by a court or the Board in any 
pioceeding identified pursuant to paragraph (c)(l)(ii) of 3 7 CFR 41 37. 
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